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In this paper, we study the problem of expected utility maxi- 
mization of an agent who, in addition to an initial capital, receives 
random endowments at maturity. Contrary to previous studies, we 
treat as the variables of the optimization problem not only the initial 
, capital but also the number of units of the random endowments. We 

' show that this approach leads to a dual problem, whose solution is 

always attained in the space of random variables. In particular, this 
technique does not require the use of finitely additive measures and 
the related assumption that the endowments are bounded. 
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1. Introduction. A classical problem in financial economics is that of 
an agent who invests his or her initial capital into a security market so 
as to maximize the expected utility of terminal wealth. In the context of 
. continuous-time models, this problem was first studied by Merton (1969, 

CN ; 1971). Using dynamic programming arguments, he derived a nonlinear par- 

■ tial differential equation for the value function of this stochastic control 

t^j- \ problem and obtained closed-form solutions for different specifications of 

' the agent's utility function. The introduction by Harrison and Kreps (1979), 

r~ | . Harrison and Pliska (1981) and Ross (1976) of the notion of equivalent mar- 

tingale measures created the possibility of solving such problems by mar- 
tingale duality methods. Under the assumption of complete markets, which 
implies that the family of martingale measures is a singleton, this approach 
was developed by Cox and Huang (1991, 1998), Karatzas, Lehoczky and 
Shreve (1987) and Pliska (1986). The essentially more difficult case of in- 
complete financial markets was considered by He and Pearson (1991a, b), 



- 1—^ 

X 



Received October 2002; revised May 2003. 
Research supported by NSF Grant DMS-98-19950. 
2 Research supported by NSF Grant DMS-01-39911. 
AMS 2000 subject classifications. 90A09, 90A10, 90C26. 

Key words and phrases. Utility maximization, random endowment, convex duality, in- 
complete markets, optimal investment, utility-based valuation, contingent claim, European 
option. 



This is an electronic reprint of the original article published by the 
Institute of Mathematical Statistics in The Annals of Applied Probability, 
2004, Vol. 14, No. 2, 845-864. This reprint differs from the original in pagination 
and typographic detail. 

1 



2 



J. HUGONNIER AND D. KRAMKOV 



Karatzas, Lehoczky, Shreve and Xu (1991) and more recently by Kramkov 
and Schachermayer (1999, 2003). In particular, the papers of Kramkov and 
Schachermayer (1999, 2003) contain minimal conditions on the agent's util- 
ity function and the financial market model which imply the key assertions 
of the theory. 

In this paper, we study the expected utility maximization problem of an 
agent who, in addition to an initial capital, receives random endowments 
(e.g., the payoffs of contingent claims) at maturity. In complete markets, 
the agent's random endowments can be perfectly replicated by a controlled 
portfolio of the traded assets. As a result, the optimal investment problem 
becomes equivalent to one without random endowments but with an aug- 
mented initial capital [see Karatzas and Shreve (1998), Chapter 4]. In incom- 
plete markets, such a transformation becomes impossible in general. In this 
case, the problem was studied by Cuoco (1997), Cvitanic, Schachermayer 
and Wang (2001) and Duffie, Fleming, Soner and Zariphopoulou (1997). 
In particular, Cvitanic, Schachermayer and Wang (2001) consider a gen- 
eral semimartingale model of a financial market and give a characterization 
of the optimal terminal wealth in terms of the solution to a dual problem. 
The results of Cvitanic, Schachermayer and Wang (2001) have recently been 
extended by Karatzas and Zitkovic (2002) to allow for intertemporal con- 
sumption. 

The dual problem in Cvitanic, Schachermayer and Wang (2001) is de- 
fined over the space (L°°)* of finitely additive measures. Unfortunately, 
this formulation requires the stringent assumption that the random en- 
dowments are bounded. The novelty of our approach is that we treat as 
the variables of the optimization problem not only the initial capital as in 
Cvitanic, Schachermayer and Wang (2001) but also the number of units of 
random endowments. We show that this extension leads to a dual problem, 
which does not require the use of finitely additive measures and therefore 
does not rely on any boundedness assumption. 

2. Main results. We consider a finite-horizon model of a financial market 
which consists of d + 1 assets: a savings account and d stocks. As is common 
in mathematical finance, we assume that the interest rate is 0; that is, the 
capital invested into or borrowed from the savings account is constant over 
time. The price process S = (<S J )i<i<d of the stocks is assumed to be a semi- 
martingale on a given filtered probability space (QjT, F = {!Ft)o<t<T-, IP)> 
where the filtration F satisfies the usual conditions of right continuity and 
completion and T is a finite maturity. 

A probability measure Q is called an equivalent local martingale measure 
if it is equivalent to P and if S is a local martingale under Q. We denote by 
A4 the family of equivalent local martingale measures and assume that 
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This rather mild condition is essentially equivalent to the absence of arbi- 
trage opportunities in the model; see Delbaen and Schachermayer (1994, 
1998) for precise statements as well as for further references. 

A self-financing portfolio is defined as a pair (x,H), where x € R repre- 
sents the initial capital and H is a predictable 5-integrable process specifying 
the number of shares of each stock held in the portfolio. The wealth process 
X of the portfolio evolves in time as the stochastic integral of H with respect 
to S: 



J 

For x > 0, we denote by X{x) the set of nonnegative wealth processes 
whose initial value is equal to x, that is, 



Since a process X £ X(x) is a nonnegative stochastic integral with respect to 
S, it is a local martingale and a global supermartingale under every Q € M 
[see Ansel and Strieker (1994)]. 

A nonnegative wealth process in X{x) is said to be maximal if its terminal 
value cannot be dominated by that of any other process in X(x). According 
to Delbaen and Schachermayer (1997) Theorem 2.5, a process is maximal 
if and only if there exists Q € M under which it is a uniformly integrable 
martingale. Note that the set of maximal strategies coincides with the set of 
"good" numeraires in the model [see Delbaen and Schachermayer (1995)]. 

The nonnegative processes from the set X{x) constitute the optimization 
set in the classical problem of optimal investment if the utility function is 
defined on the positive real line. In the presence of random endowments, 
one has to extend the domain of the problem and to consider portfolios 
with possibly negative values. If the endowments are uniformly bounded, 
as in Cvitanic, Schachermayer and Wang (2001), then the optimization set 
coincides with the set of admissible strategies whose wealth processes are 
uniformly bounded from below. In the general case of unbounded endow- 
ments, the optimization set has to be extended further to the set of acceptable 
strategies. 

Following Delbaen and Schachermayer (1997), we say that a wealth pro- 
cess X is acceptable if it admits a representation of the form X = X' — X" , 
where X' is a nonnegative wealth process and X" is a maximal process. 
Note that if the maximal process 1 + X" is chosen as a numeraire, then the 
discounted process X/(l + X") is uniformly bounded from below and hence 
is admissible under this numeraire. The definition of acceptable strategies 
is therefore very natural: they represent the numeraire-invariant version of 
admissible strategies. 




< t < T. 



(3) 



X(x) = {X > : X satisfies (2) and X = x}. 
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We also consider an economic agent whose preferences over terminal con- 
sumption bundles are represented by a utility function U : (0, oo) — ► R. The 
function U is assumed to be strictly concave, strictly increasing and contin- 
uously differentiable and to satisfy the Inada conditions: 

(4) U'(0) = lim U'ix) = oo, U'(oo) = lim U'(x) = 0. 

x— »0 x— >oo 

The convex conjugate of the agent's utility function is defined as follows: 
V(y)=swp{U(x) -xy}, y > 0. 

x>0 

It is well known that, under the Inada conditions (4), the conjugate of U is a 
continuously differentiable, strictly decreasing and strictly convex function 
satisfying V'(0) = -oo, V'(oo) = and V(0) = U(po), V(oo) = U(0) as well 
as the following bidual relation: 

U(x) = inf {V(y) + xy}, x>0. 

y>0 

Assume now that the portfolio of the agent at time consists of an initial 
capital x as well as of the quantities q = (qi)i<i<N of nontraded European 
contingent claims with maturity T and J^-measurable payment functions 
/ = (fi)i<i<N- We denote by 

TV 

(?, /) - X! 
i=i 

the payoff of this portfolio of the contingent claims and by 

X(x, q) = {X : X is acceptable, Xq = x and Xt + (q, f) > 0} 

the set of acceptable processes with initial capital x whose terminal value 
dominates the random payoff —(q, /). Note that in the case when x > and 
q = this set coincides with the set of nonnegative wealth processes with 
initial capital x. In other words, we have X(x,0) = X(x) for all x > 0. 

The family X(x,q) may very well be empty for some vector (x,q). From 
now on, we shall restrict ourselves to the set /C, which is defined as the 
interior of the set of points (x,q), where X(x,q) is not empty: 

K = mt{(x,q) e~R N+1 :X{x,q)^0}. 

As is easily seen, this set is a convex cone in R^" 1 " 1 . Hereafter we shall assume 
that it contains any point (x, q) such that x > and q = 0, that is 

(5) (x,0)eK,, x>0. 

The condition above means, in particular, that the optimization problem 
with random endowments contains the classical problem of optimal invest- 
ment as a special case. The following lemma provides a list of equivalent 
assertions to (5). 
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Lemma 1. Assume that (1) holds true. Then the following conditions 
are equivalent: 

(i) The set /C satisfies (5). 

(ii) For any q € R , there exists x 6 R such that the set X(x,q) is not 
empty. 

(iii) There is a nonnegative wealth process X such that X T > £f =1 \fi\. 

(iv) The payment functions f = (fi)i<i<N satisfy the integrability condi- 
tions: 

(6) sup E Q [|/i|] < oo for all 1 < i < N. 
Q&M 

Proof. The equivalences among (i)-(iii) are straightforward, while the 
equivalence between (iii) and (iv) follows from the general duality relation- 
ships between terminal capitals and martingale measures [see, e.g., Delbaen and Schachermayer 
(1994), Theorem 5.7]. □ 

The quantity qi of each contingent claim in the agent's portfolio being 
held constant up to maturity, the vector q represents the illiquid part of the 
portfolio. On the contrary, the initial wealth x can be freely invested into the 
stocks and the savings account according to some dynamic strategy. Given 
x and q, the goal of the agent is to maximize the expected utility of his or 
her terminal wealth. This leads to the following optimization problem: 

(7) u(x,q)± sup E[U(X T + (q,f))}, (x,q)€K. 

XeX(x,q) 

Remark 1. Contrary to Cvitanic, Schachermayer and Wang (2001) and 
Karatzas and Zitkovic (2002), we consider u to be the function of both 
x and q. As we shall see later, this approach will permit us to avoid the 
use of finitely additive measures in the formulation of the dual problem and 
to overcome the related boundedness assumption on /. 

Note that such a definition of the value function is also useful for the study 
of utility-based valuation of contingent claims [see Davis (1997), Frittelli 
(2000) and Hodges and Neuberger (1989)]. For example, a certainty equiva- 
lence price for the contingent claims / given a portfolio (x,q) is defined as 
a vector p(x,q) € R^ such that 

w(x + (q,p(x,q))) =u(x,q), 

where 

w(x)=u(x,0)= sup E[U(X T )] 
xex(x) 

is the value function of the problem of optimal investment without random 
endowments. Further, a utility-based price for / given (x, q) is defined as a 
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vector p(x, q) G such that the agent's holdings q in the claims are optimal 
in the model where the claims can be traded at time at price p(x,q). In 
other words, 

u(x,q) > u(x',q') if(x', g')€/C and x + (q,p(x, q)) = x' + (q\p(x, q)). 

Using standard arguments from the theory of convex functions, we deduce 
that a vector p(x,q) G is a utility-based price for / given (x,q) if and 
only if it has the representation: 

r 

p(x,q) = — for some (y,r) G du(x,q), 

where du(x,q) is the sub differential of u at the point (x,q). In particular, 
we deduce that the utility-based price is unique at (x,q) if and only if the 
value function u is differentiate at that point. 

We start our construction of a dual problem to (7) by introducing the set 
C, which is the relative interior of the polar cone of — JC: 

(8) £ = ri{(y,r) eR N+1 :xy + (q,r) >0 for all (x,q)g/C}. 

The set C will define the domain of the dual problem at time 0. It can be 
shown that the intersection of C with the hyperplane y = 1, that is, 

(9) V = {peJl N :(l,p)GC}, 

defines the set of arbitrage- free prices of the contingent claims /. 

Following Kramkov and Schachermayer (1999), we denote by y(y) the 
family of nonnegative semimartingales Y with initial value y and such that 
for any positive wealth process X the product XY is a nonnegative super- 
martingale, that is, 

(10) y(y) = {Y > : Y = y, XY is a super martingale for all X G Af (1)}. 

In particular, as X (1) contains the constant process 1, the elements of y{y) 
are nonnegative supermartingales. Note also that the set 3^(1) contains the 
density processes of all Q G M. . 

Given an arbitrary vector (y,r) in C, we denote by y(y,r) the set of 
nonnegative supermartingales Y G y{y) such that the inequality 

(11) E[Y T (X T + (q,f))]<xy+(q,r) 

holds true for all (x,q) G IC and X G X{x,q). Using this notation, we now 
define the dual optimization problem to (7) as follows: 

(12) v(y,r)± inf E[V(Y T )], (y,r)€C. 

Yey(y,r) 

The following theorems constitute our main results. 
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Theorem 1. Assume that conditions (1), (4) and (5) hold true and 
(13) u(x,q) <oo for some (x,q) G K.. 

Then we have: 

(i) The function u is finitely valued on fC and for any (y,r) 6 £ there 
exists a constant c = c(y, r) > such that v(cy, cr) is finite. The value func- 
tions u and v are conjugate: 

u(x,q) = inf { v(y, r) + xy + (q, r)}, (x,q)elC, 

(14) 

v(y,r)= sup {u(x,q) - xy - (q,r)}, (y,r)e£. 

(x,q)£K. 

(ii) The solution Y(y,r) to (12) exists and is unique for all (y,r) E £ 
such that v(y,r) < oo. 

Remark 2. It might be convenient to verify the validity of (13) at a 
point (x,q), where x > and q = as in this case 

u(x,0)=w(x)= sup E[U(X T )] 

XdX{x) 

is the value function of the problem of optimal investment without endow- 
ments. 

Theorem 2. Assume that conditions (1), (4) and (5) hold true and 

(15) v(y,r) <oo for all (y,r) G £. 
Then, in addition to the assertions of Theorem 1, we have: 

(i) The subdifferential of u maps K, into £, that is, 

(16) du(x,q)c£, (x,q)e!C. 

(ii) The solution X(x,q) to (7) exists and is unique for any (x,q) £ K,. In 
addition, if (y,r) G du(x,q), then the terminal values of the corresponding 
solutions are related by 

(17) Y T (y,r) = U'(X T (x,q) + («,/)), 

(18) E[Y T (y,r)(X T (x,q) + (q, /))] = xy + (q, r). 

Remark 3. The relationship (16) has the economical interpretation that 
the utility-based prices defined in Remark 1 are arbitrage-free prices for the 
contingent claims /. 

It can be shown that contrary to (16) the subdifferential of — v at (y, r) G £ 
is not necessarily contained in K,. However, it is always contained in the 
closure of this set. 
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The proofs of Theorems 1 and 2 will be given in Section 3. The validity 
of condition (15) might be difficult to verify directly. The following lemma 
provides an equivalent condition in terms of the function 

w(y)± inf mV(Y T )}, y>0, 

which is the value function of the dual problem in the classical problem of 
optimal investment without random endowments [see Kramkov and Scher- 
mayer (1999, 2003)]. Recall that we denote by V the intersection of C with 
the hyperplane y = 1; see (9). 

Lemma 2. Assume that conditions (1), (4) and (5) hold true. Then (15) 
holds if and only if 

w(y) < oo, y > 0. 

Moreover, in this case, 

(19) w(y) = inf v(y,yp), 

where the lower bound is attained. 



Proof. Define the function 

w(y) = inf v(y,yp), y>0. 

The function w is clearly convex and by Theorem 1 it satisfies 
(20) w(x) = u{x, 0) = inf {w(y) — xy}, x>0. 

y>0 

According to Theorem 2.1 in Kramkov and Schachermayer (1999), the func- 
tion w satisfies a similar equality: 

w{x) = inf {w(y) — xy}, x > 0. 
y>0 

It follows that the functions w and w are equal to each other, that is, (19) 
holds true. 

If the function v is finitely valued, then so clearly is w = w. Conversely, if 
w is finitely valued, then the closure of the set A defined by 

A = {(y,r) eC:v(y,r) < co} 

contains the origin. Moreover, the set A is convex, XA C A if A > 1 and, by 
Theorem l(i), 

C = |J XA. 

A>0 
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This readily implies that A = C, that is, that the function v is finitely valued 
on C 

Finally, fix y > and let x = —w'(y). From (20), we deduce that 

w'(x)=y, w(x) + xy = w(y). 

From Theorem 2(ii), we deduce the existence of p £ V such that (y,yp) € 
du(x,0). It follows that 

v(y,yp) = u(x,0) + xy = w(x) + xy = w(y). □ 

Following Kramkov and Schachermayer (1999), we also formulate a con- 
venient sufficient condition for the validity of the assertions of Theorem 2. 
We recall that the asymptotic elasticity of the utility function U is defined 
to be 

AE(C7)^limsup^^. 

x->oo U(X) 

Corollary 1. In addition to the conditions of Theorem 1, assume that 
(21) AE(U) < 1. 

Then (15) and all the assertions of Theorem 2 hold true. 

Proof. The condition AE(U) < 1 is equivalent to the following prop- 
erty of V [see Lemma 6.3 in Kramkov and Schachermayer (1999)]: for any 
constant c > 0, there are positive constants c\ and C2 such that 

V(y/c) <c 1 V(y) + c 2 , y>0. 

Let us fix (y,r) £ C. Since, for any c > 0, 

y(y,r) = y(cy,cr)/c, 

we deduce that v(y,r) < oo if there is a constant c = c(y,r) > such that 
v(cy, cr) < oo. However, the existence of such a constant has been established 
in Theorem 1. □ 



Remark 4. Note that (21) is the minimal condition on the utility func- 
tion only, which implies the finiteness of the dual function v and the asser- 
tions of Theorem 2. See the counterexamples in Kramkov and Schachermayer 
(1999) for the case where there are no random endowments. 

Although the functions U and —V are strictly concave and continuously 
differentiable, the value functions u and —v do not necessarily inherit any 
of these properties. Note that, due to the conjugacy relations (14), the con- 
tinuous differentiability of one of these two functions is closely related to 
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the strict concavity of the other. The following easy lemma provides a set 
of necessary and sufficient conditions for u to be strictly concave and dually 
for v to be continuously differentiable. 

Recall that a random variable g is replicable if there is an acceptable 
process X such that —X is also acceptable and Xt = g. Provided that it 
exists, such a process X is unique and is called the replication process for g. 

Lemma 3. Assume that the conditions of Theorem 2 hold true. Then 
the following assertions are equivalent: 

(i) The function u is strictly concave on /C. 

(ii) The function v is continuously differentiable on C 

(iii) For any q 6 such that q ^ 0, the random variable (q, f) is not 
replicable. 

Proof. The equivalence between (i) and (ii) is a well-known conse- 
quence of (14) and (16); see, for example, Theorems 4.1.1 and 4.1.2. in 
Hiriart-Urruty and Lemarechal (2001). Further, since U is a strictly con- 
cave function, the value function u is strictly concave if and only if for any 
two distinct points (xi,qi) S /C, i = 1,2, the terminal capitals of the corre- 
sponding optimal strategies are different: 

F[X T (x 1 ,q 1 ) + (q 1 ,f 1 )^X T (x 2 ,q 2 ) + (q 2 , f 2 )\ > 0. 

As is easily seen, this last property is equivalent to condition (iii). □ 

Remark 5. Lemma 7 provides two additional conditions, which are 
equivalent to the assertions of Lemma 3. 

The situation with the continuous differentiability of u and the strict con- 
vexity of v is more complicated. As mentioned in Remark 1, this property is 
equivalent to the uniqueness of the utility-based price. This question is stud- 
ied in our joint paper with Hugonnier, Kramkov and Schachermayer (2003), 
where we show that, in general, the utility-based price may not be unique 
and hence the function u may not be differentiable. 

3. Proofs of the main theorems. The proofs of Theorems 1 and 2 are 
based on Proposition 1. For arbitrary vectors (x,q) € K, and (y,r) £ C, de- 
note 

(22) C(x, q) = {g£~L° + :g<X T + (q, f) for some X £ X(x, q)}, 

(23) V(y, r) = {h£L° + :h< Y T for some Y G y(y, r)}. 
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With this notation, the value functions u and v defined in (7) and (12) take 
the form: 

(24) u(x,q)= sup E[U(g)], 

geC(x,q) 

(25) v(y,r)= inf E[V(h)]. 

h£V(y,r) 

Proposition 1. Assume that conditions (1) and (5) hold true. Then 
the families (C(x,q))( x ^£jc and (^(y, J"))(y,r-)e£ defined in (22) and (23) 
have the following properties: 

(i) For any (x, q) € KL, the set C(x, q) contains a strictly positive constant. 
A nonnegative function g belongs to C(x,q) if and only if 

(26) E[gh] <xy + (q, r) for all (y, r) £ C and h € T>(y, r). 

(ii) For any (y,r) £ i/ie set T>(y,r) contains a strictly positive random 
variable. A nonnegative function h belongs to T>(y,r) if and only if 

(27) K[gh] < xy + {q,r) for all (x,q) G K, and g € C(x,q). 



The proof of Proposition 1 will be broken into several lemmas. According 
to Lemma l(hi), there is a maximal positive wealth process X' whose ter- 
minal capital dominates the sum of the absolute values of the endowments: 

N 
i=l 

Denote by A4' the set of equivalent local martingale measures Q such that 
X' is a uniformly integrable martingale under Q. We have that A4' is a 
nonempty, convex subset of A4 which is dense in M with respect to the 
variation norm [see Delbaen and Schachermayer (1997), Theorem 5.2]. 



Lemma 4. Assume that the conditions of Proposition 1 hold true. Let 
(x, q) S IC, X 6 X{x, q) and Q G M' . Then X is a supermartingale under Q. 



Proof. Denote 

c= max \qj\, Z = X + cX'. 
l<i<N 

Since X and X' are acceptable processes, Z is an acceptable process. In 
addition, the terminal value of Z is nonnegative, because 

Z T = X T + cX' T >X T + (q, f) > 0. 
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It follows that Z is a nonnegative wealth process and hence is a super- 
martingale under Q. Since X' is a uniformly integrable martingale under Q, 
we deduce that X = Z — cX' is a supermartingale under Q. □ 

The following lemma is a variant of duality relations between the terminal 
values of wealth processes and martingale measures. 

Lemma 5. Assume that the conditions of Proposition 1 hold true. Let g 
be a random variable such that g > — cX' T , where c > is a positive constant, 
and denote 

(28) a(g) = sup ^q[g] < oo. 

QeM' 

Then there is an acceptable process X such that Xq = a(g) and Xt > g. 



Proof. Denote 

h = g + cX 1 ?, a{h) = sup Eq[/i]. 

QeM' 

We have h > 0, a(h) = a(g) + cX' and 

a(h) = sup Eq[/i], 
QeM 

because M' is dense in Ai with respect to the variation norm. From the 
duality relations between the terminal values of wealth processes and mar- 
tingale measures [see Delbaen and Schachermayer (1998), Theorem 5.12], we 
deduce the existence of a nonnegative wealth process Z such that Zq = a(h) 
and Zt > h. Clearly, X = Z — cX' satisfies the assertions of the lemma. □ 

Lemma 6. Assume that the conditions of Proposition 1 hold true. Then 
dK = {(x,q) <ER N+1 :X(x,q) / 0}, 
where cl/C denotes the closure of the set K, in R^" 1 " 1 . 



Proof. Let (x,q) G cl/C and let (x n , q n ) n >i be a sequence in /C that 
converges to (x,q). The assertion of the lemma will follow if we show that 
X(x,q) / 0. Fix X n e X(x n ,q n ), n > 1, and denote 



c = sup max |cr, n | 

n >ll<i<JV' 



Let t be a dense countable subset of R+. The processes Z n = X n + cX', 
n > 1, are nonnegative supermartingales under any Q £ M, and passing if 
necessary to convex combinations [see Lemma 5.2 in Follmer and Kramkov 
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(1997)], we can assume that they Fatou converge on r to a process Z, that 
is, 

Zt = lim sup lim sup Z™ = lim inf lim inf Z 1 } . 

Clearly, 

Z T - cX' T + (q, f) = Jim (Z% - cX' T + (<f , /)) 
= lim (X? + (<f,/))>0. 

n — >oo 

The process Z being a nonnegative supermartingale under any Q € A4, 
it admits an optional decomposition: Z = Z' — C where Z' is a nonnega- 
tive wealth process and C is an increasing process with initial value [see 
Kramkov (1996)]. Moreover, we deduce from Fatou's lemma that 

Z Q <Yvm\ni ZJi = x + cXL 

It follows that the process 

X = Z' - cX' + (x + cX' - Z ) 
belongs to X{x,q) and hence the set X(x,q) is not empty. □ 

Lemma 7. Assume that the conditions of Proposition 1 hold true. Then 
the following statements are equivalent: 

(i) The set £ is open in R^ +1 . 

(ii) For any q € such that q ^ 0, the random variable (q, f) is not 
replicable. 

(iii) For any nonzero vector (x,q) € c\K, there is X £ X(x,q) such that 
F[X T + {q,f)>0}>0. 

Proof. By the properties of polars of convex sets [see Rockafellar (1970), 
Corollary 14.6.1], the first item of the lemma is equivalent to the fact that 
the set cl/C does not contain any lines passing through the origin, that is, 

(29) (x,q)^0, (x,q) G cl/C (-x, —q) cl/C, 

where cl/C denotes the closure of /C. Now the equivalence of all the state- 
ments of the lemma is a rather straightforward consequence of Lemma 6. 
□ 

Remark 6 . In some of the proofs below, we shall assume that the equiv- 
alent assertions of Lemma 7 hold true. This is without loss of generality. 
Indeed, we can always arrive at this case by replacing the original family / 
with a subset /' chosen in such a way that: 
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1. Any element of / is a linear combination of elements of /' and terminal 
capitals of acceptable strategies. 

2. Any nonzero linear combination of elements of /' is not replicable. 

Note that the set /' is empty if and only if all the elements of / are replicable. 

For a vector p 6 R^, we denote by M.'(p) the subset of M! that consists 
of measures Q € M! such that Eq[/] =p. Recall that the set V denotes the 
intersection of C with the hyperplane y = 1; see (9). 

Lemma 8. Assume that the conditions of Proposition 1 hold true and let 
p € Il N . Then the set Ai'(p) is not empty if and only if p € V . In particular, 

(30) U M'(p) = M'. 

per 

Proof. Define the set 

V ' A{ pe -R N :M\p)^0}. 

We have to prove that V = V . Since both of these sets are convex and V is 
relatively open, we have that V is contained in V' if and only if 

(31) sup(g,p) < sup(g,p) for all q € R . 
p&v peV 

Fix q G and denote 

P(q) = sup (q,p) = sup E Q [(q,f)]. 
p&P' QeM' 

From Lemma 5, we deduce the existence of an acceptable process X such 
that Xq = P(q) and Xt > (<?, /)• By Lemma 6, this implies that (P(q), —q) € 
cl/C and hence that 

P(o) ~ (QiP) ^ o f° r an y P^i 

which proves (31). 

For the proof of the inverse inclusion, it is convenient to assume that the 
assertions of Lemma 7 are valid. As was noted in Remark 6, this is without 
any loss of generality. Let p £ V, (x, q) € cl/C, Q € A4'(p) and X G X(x, q) 
be as in assertion (hi) of Lemma 7, that is, such that 

nX T +(qJ)>0}>0. 

Taking into account the supermartingale property of X under Q established 
in Lemma 4, we deduce that 

0<E Q [X T + (q,f)]<x + {q,p). 

As (x, q) is an arbitrary element of cl/C, this implies that p £ V. □ 
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Lemma 9. Assume that the conditions of Proposition 1 hold true and 
let p G V . Then the density process of any Q G M'(p) belongs to y(l,p). 

Proof. The result follows from the supermartingale characterization of 
wealth processes provided by Lemma 4. □ 

Lemma 10. Assume that the conditions of Proposition 1 hold true. For 
any (x,q) G KL, a nonnegative function g belongs to C(x,q) if and only if 

(32) E Q [g] <x + {q,p) forallpeV and QeM'(p). 

Proof. If g G C(x,q), then the validity of (32) follows from Lemma 9. 
For the converse, assume that g is a nonnegative random variable such that 
(32) holds true and denote 

h = g-(q,f), c= max k|. 

1<«<JV 

We have h > —cX' T and 

a(h) = sup Eq[/i]=sup sup Eq[/i] 

= sup sup (Eq[g] - (q,p)) < x, 

where in the second equality we used (30). Lemma 5 implies the existence 
of an acceptable process X such that Xq = a(h) and X? > h. It follows that 

X T + (qJ)>g>0. 
Therefore, X belongs to X(a(h),q) and g is an element of C(x,q). □ 

We are now able to complete the proof of Proposition 1. 

Proof of Proposition 1. We start with assertion (i). Let (x,q) € /C. 
Since /C is an open set, there is 5 > such that (x — S, q) G JC. If X lies in 
X(x — 5,q), then Z = X + 5 belongs to X(x, q) and 

Z T + (q,f)<5. 

It follows that 5 € C(x,q). If g € C(x,q), then (26) follows from the con- 
struction of the sets V(y,r), (y,r) E C. Conversely, let us assume that g is 
a nonnegative random variable such that (26) holds true. By Lemma 9, the 
density processes of Q € M'(p) belong to y(l,p) for all p € V and hence 
g satisfies (32). Lemma 10 implies now that g G C(x,q) and the proof of 
assertion (i) is complete. 

We now turn to assertion (ii). As 

cV(y, r) = T>(cy, cr) for all c > 0, (y, r) G £, 
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we can restrict ourselves to the case where (y,r) = (l,p) for some p £ V . 
From Lemma 8, we deduce the existence of Q 6 By Lemma 9, the 

Radon-Nikodym derivative dQ/dF belongs to T>(l,p). Since the measures 
Q and P are equivalent, we have F(dQ/dF > 0) = 1. 

If h £ T>(l,p), then (27) follows from the construction of the set y(l,p). 
Conversely, let us assume that h is a nonnegative random variable such that 
(27) holds true. Then, in particular, 

E[gh]<l for all g eC(l,0). 

Proposition 3.1 in Kramkov and Schachermayer (1999) implies the existence 
of a process Y E 3^(1) [the set y(y) has been defined in (10)] such that 
Yr >h. Taking into account (27), we deduce that the process Z defined by 

_(Y t , t<T, 
Zt -\K t = T, 

belongs to y(l,p). Therefore, h E T>(l,p). □ 

For the proof of Theorem 1 we shall also need the following lemma. 

Lemma 11. Let £ be a set of nonnegative random variables which is 
convex and contains a strictly positive constant. Then 

(33) supM[U(xg)] = sup M[U(xg)], x>0, 

g££ g£cl£ 

where cl£ denotes the closure of £ with respect to convergence in probability. 

Proof. Without loss of generality, we can assume that the set £ con- 
tains 1. Denote, for x > 0, 

4>(x) = supE[U(xg)], i/j(x) = sup K[U(xg)]. 
g££ g£cl£ 

Clearly, <f> and i/j are concave functions and <j) < ip. If 4>(x) = oo for some 
x > 0, then, due to concavity, (j> is infinite for all arguments and the assertion 
of the lemma is trivial. Hereafter we assume that 4> is finite. 

Fix x > and g € cl£. Let (g n ) n >i be a sequence in £ that converges to 
g almost surely. For any 5 > 0, we have 

®[U(xg)] < nUixg + 5)] < liminf E\U(xg n + 5)} < Mx + 5), 

n — >oo 

where the first inequality holds true because U is increasing, the second one 
follows from Fatou's lemma and the third one follows from the facts that £ 
is convex and contains 1. Since <f> is concave, it is continuous. It follows that 

ip(x) = sup K[U {xg)\ < lim <fi(x + 5) = <j)(x). 

ged£ s ~*° LI 
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Proof of Theorem 1. The function u is clearly concave on /C. Since 
the set K, is open and u(x, q) < oo for some (x, q) G fC, we deduce that u is 
finitely valued on K,. 

For (y,r) G £, we define the sets 

A (y, r ) - {( x ,Q) €/C:x?/+ (q,r) < 1}, 
C= |J C(x,q), 

(x,q)eA(y,r) 

and denote by C the closure of C with respect to convergence in probability. 
From Lemma 11 and the definition of the set C, we deduce that 

supK[U(zg)] = supE[U(zg)] = sup u(x,q), z > 0. 

geC g& c (x,q)ezA(y,r) 

Further, we claim that 

(34) sup u(x,q) < oo, z > 0. 

(x,q)ezA(y,r) 

To prove (34), assume that the set C is open. As was explained in Remark 6, 
this is without any loss of generality. In this case, the set A(y, r) is bounded 
and (34) follows from the concavity of u. 
From Proposition 1, we deduce that 

heV(y,r) O E[gh]<l Mg^C. 

It follows that the sets C, and V(y,r) satisfy the assumptions of Theorem 
3.1 in Kramkov and Schachermayer (1999). If v(y, r) < oo, then this theorem 
implies the existence and uniqueness of the solution h(y,r) to (25). It also 
implies the existence of a strictly positive constant c = c(y, r) such that 
v(cy,cr) < oo as well as the second conjugacy relationship in (14): 

(35) v (y, r) = sup< supE[C/(zp)] — z > = sup {u(x, q) — xy — (q, r)}. 

z>0lg£C J (x,y)e!C 

Finally, the first equation in (14) follows from the second one by the general 
properties of conjugate functions [see, e.g., Rockafellar (1970), Section 12] 
and the fact that the relative interior of the domain of the function v defined 
by (35) is a subset of C. □ 

For the proof of Theorem 2, we shall also need the following lemma. 

Lemma 12. Assume that the assumptions of Proposition 1 hold true. Let 
sequences (y n ,r n ) G C and h n G T>(y n ,r n ), n > 1, converge to (y,r) G R.^ 1 
and h G L^{_, respectively. If h is a strictly positive random variable, then 
(y, r) G C and h G T>(y, r) . 
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Proof. Without loss of generality, we can assume that the assertions 
of Lemma 7 are valid. Let (x,q) G cl/C and X £ X{x,q) be as in assertion 
(hi) of Lemma 7, that is, such that 

P[X T + (g,/)>0]>0. 

Combining this property with Proposition 1 and Fatou's lemma, we deduce 
that 

0<E[h(X T + (q,f))]<xy+(q,r). 

As (x,q) is an arbitrary element of cl/C, this implies that (y,r) £ C Finally, 
Fatou's lemma and Proposition 1 imply that h € T>(y,r). □ 

Proof of Theorem 2. Since 

(36) U(x) < V(y) + xy, x>0,y>0, 

we deduce from Proposition 1 that if v(y,r) < oo for some (y,r) £ C, then 
u(x,q) < oo for all (x,q) £ /C. In particular, all of the assumptions of Theo- 
rem 1 hold true. For (x,q) € /C, define the sets 

B (x, q) = {{y, r)eC:xy+ (q, r) < 1}, 

V± |J V(y,r) 
(y,r)eB(x,q) 

and denote by T> the closure of T> with respect to convergence in probability. 
Using these definitions, we clearly have 

inf E[V(zh)} < inf K\V(zh)] = inf v{y, r)<oo, z>0. 

heV heV (y,r)ezB(x,q) 

From Proposition 1, we deduce that 

geC(x,q) O E\gh]<l V/ieD. 

It follows that the sets C{x,q) and T> satisfy the assumptions of Theorem 
4 in Kramkov and Schachermayer (2003). This implies the existence and 
uniqueness of the solutions g(x,q) to (24) and X(x,q) to (7), which are 
related by the following equality: 

X T (x,q) =g(x,q) - (q,f). 

Denoting 

h=U'(g(x,q)), z = E[g(x,q)h], 

we also deduce from this theorem that h belongs to zT> and is the unique 
solution to the optimization problem: 

E[V(h)]= inf -E[V(h)]. 

h£zT> 
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Since F[h > 0] = 1, we deduce from Lemma 12 the existence of (y,r) € 
B(x,q) such that the set T>(y,r) contains h. Clearly, for this (y,r) we have 
that 

(37) xy + (q,r) = z=E[g(x,q)h] 
and that the solution to (25) satisfies 

(38) h(y,r)=h = U'(g(x,q)). 
Since 

U(g{x,q))=V(h)+g(x,q)h, 

we deduce that 

(39) u(x,q) = v(y,r) + xy + (q,r), 

which, according to Rockafellar (1970), Theorem 23.5, is equivalent to (y, r) 6 
du(x,q). In particular, we have 

(40) du(x,q)f]C^0. 

Conversely, if (y,r) belongs to £ and satisfies (39), that is, (y, r) G C n 
du(x, q), then 

E[\V(h(y,r))+g(x,q)h(y,r) - U(g(x,q))\] 

= E[V(h(y, r)) + g)h(i/, r) - C/ (ff(x, (?))] 
< v(y, r)+xy+ (q, r) - u(x, q) = 0, 

which readily implies (37) and (38). 

To conclude the proof of the theorem we now need to show that 

du(x, q) C C. 

Let (y, r) G du(x,q). From (40) and the fact that du(x,q) is a closed con- 
vex set, we deduce the existence of a sequence (y n ,r n ) in du(x,q) f) C that 
converges to (y,r). As we have proved already, any of the sets T>{y n ,r n ) 
contains the strictly positive random variable U'(g(x,q)). Lemma 12 implies 
now that (y, r) EC. □ 
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